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ABSTRACT 

Superpixel Segmentation using Lazy Random Walk Algorithm to attain the initial super pixel by selecting the seed location on input 
image according to the probabilities of each pixel and then boundaries of initial superpixels are attained according to the 
probabilities and commute time. The original superpixels are iteratively optimized with novel energy utility, which is distinct on the 
commute time and texture quantity. In proposed lazy random walk algorithm the performance of superpixel is superior with 
relocating the midpoint location of superpixel and isolating the large into miniature ones. LRW algorithm with self-loops has the 
qualities of segmenting the frail boundaries and difficult texture regions extremely fit with the new global probability maps and the 
commute time approach. The experimental results have confirmed that proposed method achieves recovered act than preceding 
super pixel approaches. 


Index Terms: Lazy random walk, commute time, optimization, superpixel, texture 


1. INTRODUCTION segment superpixels. Superpixels are bigger related region of 
A Superpixel can be described as a cluster of pixels which have _ pixel and sometime also called image patches. Superpixels are 
similar uniqueness. Superpixels can be especially useful for generally distinct as constricting and combining homogenous 
image segmentation. There are a lot of algorithms available to _ pixels in the image, which have been extensively used in many 
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computer vision applications like image segmentation and 


object recognition. The superpixel concept as essential the 
perceptually homogenous regions using the normalized cuts 
(NCuts) algorithm. 

Superpixels are often used as a pre-processing step for 
superior level algorithms, that fall the computations from 
millions of pixels to thousands of superpixels .Superpixel can 
cause substantial speed-up of subsequent processing since the 
number of superpixels of an image varies from 25 to 2500, in 
compare to hundreds of thousands of pixels. Super pixels are 
the consequence of perceptual grouping of pixels, or seen the 
former method approximately, the results of an image over 
segmentation. Superpixels carry additional information than 
pixels and align enhanced with image edges than rectangular 
image patches. 

The pixel-grid representation is an “artifact" of a digital 
imaging process and not a usual one. Most of the image 
processing algorithms visualise image with the use of pixel-grid, 
as the basic version. Various stochastic models of images are 
often defined on this regular grid. It would be more usual, and 
most probably more efficient, to work with meaningful entities 
obtained from a low-level grouping process. The consequence 
of over-segmentation partitions the image into fewer numbers 
of segments known as superpixels. A Superpixel can be 
described as a cluster of pixels which have similar uniqueness. 
Superpixels can be especially useful for image segmentation. 
There are a lot of algorithms available to segment superpixels. 
Superpixels are bigger related region of pixel and sometime 
also called image patches. 

Super pixels are the consequence of perceptual grouping 
of pixels, or seen the former method approximately, the results 
of an image over segmentation. Superpixels carry additional 
information than pixels and align enhanced with image edges 
than rectangular image patches. The main merit of superpixel 
is to offer a more usual and perceptually significant illustration 
of the input image. Therefore, comparison is done by 
conventional pixel illustration of the image. The superpixel 
description deeply decreases the amount of image primitives 
and progresses the delegate effectiveness and it is more 
suitable and successful to calculate the region based visual 
features by superpixels, which will give the vital benefits for the 
vision tasks like object recognition. 

Every different superpixel generation approach has their 
own advantages and disadvantages that may enhance serve the 
need for processing the respective image. For example, if 
adherence to image boundaries is of paramount importance, 
the graph-based method may be a perfect selection. 
Conversely, if superpixels are to be used to construct a graph, a 
method that creates a more normal lattice is probably a better 
choice. 
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Since, no one ideal approach exists which constitutes for all 
applications, the following properties are generally desirable for 
superpixels: 1) Superpixels should exhibit good adherence to 
image boundaries. 2) At pre-processing step, superpixels should 
have reduced computational complexity, should be fast to 
compute, memory efficient, and simple to use. 3) At actual 
segmentation step, superpixels are supposed to linearly enlarge 
the speed and improve the quality of the consequences as well. 

The main advantage of superpixel is to provide a more usual 
and perceptually significant illustration of the input image. 
Consequently, compared to the traditional pixel representation 
of the image, the superpixel representation very much reduces 
the number of image primitives and improves the 
representative efficiency. There is a large amount of literature 
on automatic superpixel algorithms, for example, normalized 
cuts [4], mean shift algorithm [6], graph-based method [2], 
Turbopixels [3], SLIC superpixels [13] and optimization-based 
superpixels [5]. conversely, each superpixel method has its own 
advantage and drawback that may be better suited for a 
particular application. 

It is still challenging to develop a high quality superpixel 
algorithm, which avoids the under-segmentation and locally 
groups the pixels respecting the intensity boundaries. The 
desired properties of an ideal superpixel algorithm should not 
only adhere well to object boundaries of image, but also 
maintain the compact constrains in the complicated texture 
regions. In order to satisfy these desired requirements, we 
develop a new image superpixel segmentation method by the 
lazy random walk (LRW) and energy optimization algorithm to 
achieve better performance than the previous approaches. 


Figure 1 Superpixel Image 


Figure1 shows the example of image segmented using 
SLIC algorithm [13] into 
approximate size 64, 256 and 1024 pixels. The superpixels are 


Achanta et al, superpixels of 


compact, uniform in size, and adhere well to region boundaries. 


2. RELATED WORK 

The existing superpixel approaches can be roughly classified 
into two categories. The first category of algorithms that do not 
consider the compactness constraints during the superpixels 
generation procedure, such as mean shift, and graph based 
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algorithms. These algorithms produce superpixels by over- 


segmenting the image, in order to avoid the superpixels 


crossing the object boundaries. Non consideration of 
compactness constrains produces the superpixels of highly 
irregular shapes and sizes. The second category of superpixel 
algorithms considers the compactness constrains, such as 
normalized cuts, lattice cut, TurboPixels, and graph cut 
approaches. 

M. Y. Liu, O. Tuzel, S. Ramalingam, and R. Chellappa [1] has 
proposed an objective utility consists of two mechanisms: 
entropy rate of a random walk on a graph and a balancing term. 
This method starts with partition the input image into K 
superpixel and then graph is constructed. The entropy rate 
helps to compact and homogeneous clusters cheering 
separation of images on perceptual boundaries and helping 
superpixels overlapping with merely a particular object. 
Fezenszwalb and Huttenlocher [2] has proposed graph-based 

scheme that has 
That 


clustering of pixel nodes on a graph, such that each segment, or 


segmentation been used to generate 


superpixels. algorithm performs an agglomerative 
superpixel, is the shortest spanning tree of the constituent 
pixels. It has been used for depth estimation. It wasO(NlogN) 
complex and was quite fast in practice as compared to 
Normalized cut. 

A. Levinshtein, A. Stere, K. Kutulakos, D. Fleet, S. Dickinson, 
and K. Siddiqi [3] has proposed TurboPixel algorithm employing 
the level set based geometric flow evolution from the 
homogenously located seeds in the image. Theoretically that 
algorithm places initial seeds in location, iterate the image with 
additional steps until no additional progression is possible. 
Iteration consists of developing the boundary for T time steps, 
manipulative the skeleton of unassigned region, moderize the 
speed of each boundary pixel and unassigned pixel in 
boundary’s vicinity. 

Ren and Malik [4] propose using Normalized Cut (NCut) 
forsuperpixel segmentation. NCut has the nice property of 
producing superpixels with similar sizes and compact shapes. 
One drawback of NCut is its computational requirement— it 
takes several minutes for segmenting an image of moderate 
(481x321) size. 

O. Veksler, Y. Boykov, and P. Mehrani [5] has proposed the 
superpixel separating difficulty with in an energy decrease 
skeleton and also optimize through graph cuts. It showed a 
dissimilarity of the vital energy, which permits a transaction 
between a fewer usual tessellation but extra precise boundaries 
or superior efficiency. A superpixel is an image space which is 
better aligned with intensity edges than a rectangular patch. 

D.Comaniciu and P.Meer [6] has proposed mean shift 
algorithm that generates image segments by recursively moving 
to the kernel smoothed centroid for every data point in the pixel 
feature space, effectively performing a gradient ascent .The 
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generated segments/superpixels can be large or small based on 
the input kernel parameters, but there is no direct control over 
the number, size, or compactness of the resulting superpixels. 

A superpixel lattice was generated by [7] by finding optimal 
vertical (horizontal) seams/paths that cut the image, within 
vertical (horizontal) strips of pixels, using graph cuts on strips of 
the image. While superpixel lattice allows control of the size, 
number, and compactness of the superpixels, the quality and 
speed of the output strongly depend on _ pre-computed 
boundary maps. 

Lattice superpixel [8] was derived from global optimization. 
The superpixel generation is initialized with a grid, and the 
graph cut algorithm is adopted to iteratively optimize the 
vertical and horizontal seams. 

L.Grady [9] about the 
segmentation. It used the prelabeled pixels, which was used to 


discussed interactive image 
avoid the boundary crossing. The unlabeled pixels are present 
in the top of the list in the random walker that establishes the 
probability in random walker. Actually it fully depends for the 
associatation with the current seed and all its equivalent seed. 
But it ignores the dependency among the seeds, not only with 
the equivalent seeds. It can’t able to work for frail boundary 


images. 


3. LRW APPROACH 

The RW algorithm has been used extensively for interactive 
image segmentation in the image processing and computer 
vision literatures [12]. The RW algorithm calculates the first 
arrival probability to facilitate a random walk starts at one pixel 
first reaches one of the seeds with each label, and then that 
pixel is denoted as the same label with maximum probability of 
the equivalent seed. A random walk starts from a pixel must first 
arrive at the position of the prelabeled seed, and thus it only 
considers the local relationship between the current pixel and its 
corresponding seed. This first arrival probability ignores the 
whole relationship between the current pixel and other seeds. 
As denoted by Grady [12], these limitations of the original RW 
method give the reason that it suffers from the weak boundary 
and complex texture segmentations. 

In order to make full use of the global relationship between 
the pixel and all the seeds, we add the self-loop over the graph 
vertex to make the RW process lazy, which is inspired by the 
original LRW concept [12]. However, the original LRW was 
initially proposed for the website data classifying and mining 
applications. 


4. SUPERPIXEL INITIALIZATION 

The superpixel initialization is computed by commute time. CTj 
to represent the predictable numbers of steps used for a lazy 
random walk that begins at node v; to reach node vjand then 
return to vj. CTj is called the commute time. Commute time is 
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computed from the Laplacian spectrum using the discrete 


function. The commute time for image segmentation using the 
eigenvector corresponding to the smallest eigenvalue of the 
commute time matrix. The Eigen vector does not change in the 
direction in the transformation. The value of change in length of 
the vector is known as Eigen value. 


A. Weight estimation 

The edge weights are calculated on dissimilarity between pixel 
intensities .First a graph G=(V,E) is constructed on given input 
image (xj). In that graph includes set of nodes V that match to 
a pixel in the image and edges in E connect certain pair of 
neighboring pixels. The degree of each vertex is computed as 


di= Ly Wy 


The degree vertex means to be sum of the weights of all the 
edges that occurrence on vj. The edge-weight calculation 
process is used to characterize the image intensity changes. This 
edge-weight evaluates the relationship between two 
neighboring nodes viand v; ,and therefore Wijis described by the 


Gaussian weighting function given in eqn1 


lae-ajl2, 


wig=exp(-—F 


(1) 


where gi and gj denote the image intensity values at two 
nodes,v,and v;, and 6 is identity factor. The value of 26? is 1/30. 


B. Adjacency Matrix Estimation 
The neighborhood relations are summarized by the adjacency 
matrix. The adjacent node shares the common vertex and it is 


given eqn2. 
W;; = a w,;ift~j, (2) 
0 otherwise, 


Where i~f means node viand node vjare the closest nodes. 


Node is nothing but the pixel in an image. 


Later than row normalize the adjacency matrix it is to identify 
the alternation probability matrix is given in eqn 3 


1 —aifi=j, 
Py= a.— ifirnj, (3) 
L 
0 otherwise 


Eqn3 can also be write down as P=(1-ai)l+aD7*W where D is 


a diagonal matrix with the (i,i)-th entry having the value dj. This 
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means with the probabilitya, it follows one link which connects 
the vertex of the current position and is chosen with the 
probability proportional to the weight of the link, and with the 
probability (1-a) , just saying at the current position. 


C. Laplacian Matrix Estimation 


The graph laplacian directly incorporates a graph structure 
describing the local neighbourhood relation between data 
points. Laplacians finds a smooth function such that it’s values 
in seed pixels are close to the associated labels and it is allowed 
to vary only on low-density regions of the input space. The 
neighbourhood relations are summarized by the adjacency 
matrix. The laplacian matrix is given in eqn4 


d;ift=j 
Lj=) —aw,jifixy (4) 
0 otherwise 


Eqn4 can be also write-down as 
L=D-ai (5) 


Here D is the diagonal matrix.W is the adjacency matrix.Dj is the 
degree of the ith vertex vi. 


CTijto represent the predictable number of steps used for a lazy 
random walk that begins at node v; to reach node vjand then 
return to vi.CTij is called the commute time between vj and vj. 


After that obtain the Normalized laplacian matrix using the 
given eqn 6 


L=(I-« D*wo-™) (6) 


Later than normalizing the commute time toone that is the 
amount of commute time from a node to other nodes. 
Normalized CT is given in eqn 7 
1-L, ifisj 
ctype FT 
1 ifi=j 


The commute time is inversely propotional to the probability. 


The LRW algorithm will be at a pixel x; with the boundary 


likelihood probabilities of label | as given in eqn 8 
fi=(I-S)*yt(8) 
Where | is the identity matrix and S is given by 


s-D-2yp-h2 


Here D is the diagonal matrix and W is the adjacency matrix . 
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At last reach the labeled boundaries of super pixel from the 


commute time is given in eqn 9 


R(X) =argeninyg CT (cl, xi) = ar grax CT (clk,xi) (9) 


clk stands for the center of the I-th super pixel, and the label 
Ikis allocated to each pixel xito find the boundaries of super 
pixels. Next the label of the seed among the smallest amount 
commute time is allocated to the related pixel the same as the 


concluding superpixel label. 


LRW Based Superpixel Initialization Algorithm 


Input: Input image I(x;) and an integer of initial seeds K 
Step1: Define an adjacency matrix. 


Step2: Construct the laplacian matrix S=D-/*WD-"/? in which 
D is a diagonal matrix 


Step3: Compute fc= (I-25) 4 yy, 


Step4: Compute R(x) =argmaxyg.CT(cli,xi) to obtain the labels 
by assigning label R(x;) to each pixel xi, 


Step5: obtain superpixel S;, based on k. 


ouput: the initial superpixel results Si 


5. SUPERPIXEL OPTIMIZATION 
In this module the performance of super pixels is improved with 
energy optimization function 


by via the compactness 


constraints. The superpixel algorithm rely on minimizing 


objective utilities to implement color homogeneity. 
Optimization techniques are built in the lead progressively 
accumulating cuts, or grow superpixels starting from various 


estimated centers. 
E=E\(Area(S) —Area(5))*+E, Mi cr(c™x) (10) 


eT (c7*.x) ——>Commute time between seed point c;* and pixel 
x. 
Ti,is a consequence task it is used to find the commute time 


between the seed and the pixel. 

The minimization of smooth item gives the optimal 
relocation center position of superpixel. The new center 
relocates is given in eqn 11 
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The texture characterize of local binary pattern (LBP) to 
calculate the texture information. The LBP value of each pixel is 
given in eqn 12 

LBA -EEss(grg)2 


Where q is the gray level of LBP, r is the radius of the circle 
around pixel i, and g means the gray value of image. g = 8 and r 
= 1. Based on the LBP texture feature, the area of superpixel is 
given in eqn 13 


Area(S1)= Siew LBP, 


=, Lies LBP; 
Area{ 5) -— (13) 


wheredrea(Sljis the region of superpixels, and Arem( 5) is the 
average region of the superpixel and Nspis the user described 
quantities of superpixels. The region of superpixel is huge when 
it includes greatly texture information. The parameter Th 
manages the amount of iterations in superpixel optimization 
process. The ratio of superpixel area and the average superpixel 
area is greater than threshold the large super pixel is separated 
Here threshold helps to the 
superpixel whether it is split or not. The Prinicipal component 


into two little superpixels. 


analysis method is used to split the superpixel. Later than 
splitting process, the 2 new superpixels are found and the 
equivalent two new centers Cipeye1, Cipeye2 is given in eqn 14 


5 zx €T (cx) 
f(=-a)<>0}""* Teal * 
= eT ox) (1 4) 


Et(xopo0)"® Tee, 


Ce = 


[xleeSp(e-a)sce]” oy 


Superpixel Optimization Algorithm 


Input: Initial Superpixel S| and an integer Nsp 
Step1: To Compute the center of the Superpixl S; 


Step2: Splitting the Large Superpixel into two small 


Superpixel and obtain two new center 
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Step3: Refine Initial Superpixel S; with center of the 


Superpixel S;, two new centers 
Step4: Run steps 1 to 3 iteratively until convergence 


Output: The final optimized superpixel results 


6. EXPERIMENTS 

In this section, the superpixel results are analyzed to explain the 
influence with different parameter settings. The proposed 
superpixel algorithm is then qualitatively tested with several 
representative examples in BSD benchmark. In order to obtain 
an objective and intuitive comparison and then quantitatively 
evaluate this algorithm by three different error metric 
measurements. Comparison results between RW method and 
LRW algorithm before and after optimization, and analyze the 
computational complexity of the representative superpixel 


algorithms. 


A. Under Segmentation Error (USE) 

The under segmentation error estimation capacity checks the 
deducting area by the superpixel that overlies the given 
ground-truth segmentation. K is the seed points. 


0.5 


0.45 


RW 


0.25 “i LRW 


Figure 2 The Curve of Under Segmentation Error 


This graph shows the performance of the LRW algorithm 
achieves better performance than RW algorithm. 


B. Boundary Recall (BR) 
Boundary recall measurement calculates the ratio of the ground 
truth boundaries that decrease within the adjacent superpixel 
boundaries. 

Lazy Random Walk algorithm precisely calculates the 
boundary than Random Walk algorithm. 
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Figure 3 The Curve of Boundary Recall 


C. Achievable Segmentation Accuracy (ASA) 

Achievable Segmentation Accuracy calculates the maximum 
achievable accuracy by labeling every superpixel with the label 
of ground truth segmentation that has the major overlie area. 


Figure 4 The Curve of Achievable Segmentation Accuracy 


Lazy Random Walk algorithm achieves highest accuracy than 
Random Walk algorithm. 


7. CONCLUSION 

We have present a natural image superpixel approach using the 
Lazy Random Walk and energy optimization algorithm. This 
method first starts with the Lazy Random Walk algorithm to 
attain the initial superpixel consequences by selecting the seed 
locations on input image. Then it further optimize the labels of 
superpixels to improve the reliability and boundary devotion 
performance by relocating the center positions of superpixels 
and separating the huge superpixels into two small 
homogeneous ones in an energy optimization skeleton. The 
experimental results have established that the super pixel 
algorithm accomplishes enhanced performance than the 
preceding well-known superpixel approaches. This algorithm is 
capable of obtaining the good boundary adherence in the 
difficult texture and weak edge regions, and the proposed 


optimization strategy considerably improves the quality of 
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superpixels. In future work, optimized Superpixel segmentation 
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